Skip to content

smoke test: support ceph storage pools#11931

Open
weizhouapache wants to merge 3 commits intoapache:4.22from
weizhouapache:4.22-smoke-tests-on-ceph
Open

smoke test: support ceph storage pools#11931
weizhouapache wants to merge 3 commits intoapache:4.22from
weizhouapache:4.22-smoke-tests-on-ceph

Conversation

@weizhouapache
Copy link
Contributor

@weizhouapache weizhouapache commented Oct 29, 2025 •
edited
Loading

Description

This PR improves and fixes some tests on ceph storage

  • enable direct download tests on ceph
  • enable over provisioning tests on ceph
  • enable volume snapshot tests on ceph
  • fix test_human_readable_logs.py by increasing timeout of restarting to 120 seconds
  • skip live vm migration for VMs with volume migration between ceph storage pools
  • skip vm snapshots for VMs on ceph
  • skip volume migration test between ceph storage pools (fixed by ceph: fix offline volume migration between ceph pools #12103)
  • skip volume encryption tests on ceph

Types of changes

  • Breaking change (fix or feature that would cause existing functionality to change)
  • New feature (non-breaking change which adds functionality)
  • Bug fix (non-breaking change which fixes an issue)
  • Enhancement (improves an existing feature and functionality)
  • Cleanup (Code refactoring and cleanup, that may add test cases)
  • Build/CI
  • Test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

  • Major
  • Minor

Bug Severity

  • BLOCKER
  • Critical
  • Major
  • Minor
  • Trivial

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

@boring-cyborg boring-cyborg bot added component:integration-test Python Warning... Python code Ahead! labels Oct 29, 2025
@weizhouapache
Copy link
Contributor Author

weizhouapache commented Oct 29, 2025

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Oct 29, 2025

@weizhouapache a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@weizhouapache weizhouapache added this to the 4.22.1 milestone Oct 29, 2025
@codecov
Copy link

codecov bot commented Oct 29, 2025 •
edited
Loading

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 17.45%. Comparing base (223fc25) to head (844de76).

Additional details and impacted files 
@@             Coverage Diff              @@
##               4.22   #11931      +/-   ##
============================================
- Coverage     17.56%   17.45%   -0.11%     
+ Complexity    15548    15513      -35     
============================================
  Files          5910     5913       +3     
  Lines        529129   529385     +256     
  Branches      64634    64677      +43     
============================================
- Hits          92942    92425     -517     
- Misses       425730   426543     +813     
+ Partials      10457    10417      -40
Flag Coverage Δ
uitests 3.58% <ø> (+<0.01%) ⬆️
unittests 18.51% <ø> (-0.12%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@blueorangutan
Copy link

blueorangutan commented Oct 29, 2025

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 15584

@weizhouapache
Copy link
Contributor Author

weizhouapache commented Oct 29, 2025

@blueorangutan test matrix

@blueorangutan
Copy link

blueorangutan commented Oct 29, 2025

@weizhouapache a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Oct 30, 2025

[SF] Trillian test result (tid-14741)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 71700 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14741-kvm-ol8.zip
Smoke tests completed. 147 look OK, 2 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_02_migrate_VM_with_two_data_disks Error 38.80 test_vm_life_cycle.py
ContextSuite context=TestVmSnapshot>:teardown Error 288.49 test_vm_snapshots.py

@blueorangutan
Copy link

blueorangutan commented Oct 30, 2025

[SF] Trillian test result (tid-14742)
Environment: kvm-ubuntu22 (x2), zone: Advanced Networking with Mgmt server u22
Total time taken: 87202 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14742-kvm-ubuntu22.zip
Smoke tests completed. 146 look OK, 3 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_02_migrate_VM_with_two_data_disks Error 38.29 test_vm_life_cycle.py
ContextSuite context=TestVmSnapshot>:teardown Error 291.59 test_vm_snapshots.py
test_hostha_enable_ha_when_host_disabled Error 3.67 test_hostha_kvm.py
test_hostha_enable_ha_when_host_in_maintenance Error 305.91 test_hostha_kvm.py

@weizhouapache
Copy link
Contributor Author

weizhouapache commented Oct 30, 2025

@blueorangutan package

@blueorangutan
Copy link

blueorangutan commented Oct 30, 2025

@weizhouapache a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@blueorangutan
Copy link

blueorangutan commented Oct 30, 2025

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 15597

@weizhouapache
Copy link
Contributor Author

weizhouapache commented Oct 30, 2025

@blueorangutan test

@blueorangutan
Copy link

blueorangutan commented Oct 30, 2025

@weizhouapache a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

@blueorangutan
Copy link

blueorangutan commented Oct 31, 2025

[SF] Trillian test result (tid-14744)
Environment: xcpng82 (x2), zone: Advanced Networking with Mgmt server ol9
Total time taken: 129543 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14744-xcpng82.zip
Smoke tests completed. 139 look OK, 10 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_01_events_resource Error 822.70 test_events_resource.py
test_08_upgrade_kubernetes_ha_cluster Failure 3787.76 test_kubernetes_clusters.py
test_01_non_strict_host_anti_affinity Error 520.75 test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity Error 130.06 test_nonstrict_affinity_group.py
test_02_list_snapshots_with_removed_data_store Error 18.51 test_snapshots.py
test_02_list_snapshots_with_removed_data_store Error 18.52 test_snapshots.py
test_01_ssl_offloading_isolated_network Failure 949.48 test_ssl_offloading.py
test_01_vpn_usage Error 1.18 test_usage.py
test_01_scale_up_verify Failure 579.72 test_vm_autoscaling.py
test_11_destroy_vm_and_volumes Error 30.02 test_vm_life_cycle.py
ContextSuite context=TestVmSnapshot>:teardown Error 314.04 test_vm_snapshots.py
test_01_migrate_vm_strict_tags_success Error 78.07 test_vm_strict_host_tags.py

@blueorangutan
Copy link

blueorangutan commented Oct 31, 2025

[SF] Trillian test result (tid-14753)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 58456 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14753-kvm-ol8.zip
Smoke tests completed. 149 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File

@blueorangutan
Copy link

blueorangutan commented Nov 2, 2025

[SF] Trillian test result (tid-14743)
Environment: vmware-70u3 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 292096 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14743-vmware-70u3.zip
Smoke tests completed. 136 look OK, 13 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_08_upgrade_kubernetes_ha_cluster Failure 3693.33 test_kubernetes_clusters.py
test_list_vms_metrics_admin Error 3633.14 test_metrics_api.py
test_list_vms_metrics_history Error 25.23 test_metrics_api.py
test_list_volumes_metrics_history Error 3606.95 test_metrics_api.py
ContextSuite context=TestISOUsage>:setup Error 0.00 test_usage.py
test_01_vpn_usage Error 1.22 test_usage.py
test_01_deploy_vm_on_specific_host Error 26.64 test_vm_deployment_planner.py
test_02_deploy_vm_on_specific_cluster Error 3604.05 test_vm_deployment_planner.py
test_03_deploy_vm_on_specific_pod Error 2.66 test_vm_deployment_planner.py
test_04_deploy_vm_on_host_override_pod_and_cluster Error 4.61 test_vm_deployment_planner.py
test_05_deploy_vm_on_cluster_override_pod Error 3.61 test_vm_deployment_planner.py
test_09_expunge_vm Failure 424.88 test_vm_life_cycle.py
ContextSuite context=TestVmSnapshot>:teardown Error 299.52 test_vm_snapshots.py
test_01_migrate_vm_strict_tags_success Error 3607.74 test_vm_strict_host_tags.py
test_02_migrate_vm_strict_tags_failure Error 4.65 test_vm_strict_host_tags.py
test_01_restore_vm_strict_tags_success Error 20.56 test_vm_strict_host_tags.py
test_02_restore_vm_strict_tags_failure Error 3607.25 test_vm_strict_host_tags.py
test_01_scale_vm_strict_tags_success Error 23.20 test_vm_strict_host_tags.py
test_02_scale_vm_strict_tags_failure Error 3606.02 test_vm_strict_host_tags.py
test_01_deploy_vm_on_specific_host_without_strict_tags Error 27.80 test_vm_strict_host_tags.py
test_02_deploy_vm_on_any_host_without_strict_tags Error 3605.43 test_vm_strict_host_tags.py
test_03_deploy_vm_on_specific_host_with_strict_tags_success Error 3603.58 test_vm_strict_host_tags.py
test_04_deploy_vm_on_any_host_with_strict_tags_success Error 3608.30 test_vm_strict_host_tags.py
test_04_deploy_vnf_appliance Error 2022.66 test_vnf_templates.py
ContextSuite context=TestVnfTemplates>:teardown Error 1817.67 test_vnf_templates.py
ContextSuite context=TestCreateVolume>:teardown Error 2264.70 test_volumes.py
test_01_verify_ipv6_vpc Error 3791.85 test_vpc_ipv6.py
test_01_verify_ipv6_vpc Error 3792.19 test_vpc_ipv6.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Error 1924.77 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Error 1923.29 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Error 1819.42 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Error 1925.69 test_vpc_redundant.py
test_05_rvpc_multi_tiers Error 1915.19 test_vpc_redundant.py
test_01_VPC_nics_after_destroy Failure 5719.14 test_vpc_router_nics.py
test_01_redundant_vpc_site2site_vpn Failure 1912.43 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Error 1912.58 test_vpc_vpn.py
test_01_vpc_site2site_vpn_multiple_options Error 2564.26 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Error 1937.20 test_vpc_vpn.py

@weizhouapache weizhouapache force-pushed the 4.22-smoke-tests-on-ceph branch from ddfdacf to 844de76 Compare December 9, 2025 10:38
@weizhouapache weizhouapache changed the base branch from main to 4.22 December 9, 2025 10:38
@rajujith rajujith moved this to In Progress in Apache CloudStack 4.22.1 Jan 7, 2026
@weizhouapache weizhouapache marked this pull request as ready for review January 28, 2026 09:30
@weizhouapache
Copy link
Contributor Author

weizhouapache commented Jan 28, 2026

ready for review and testing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

component:api component:integration-test component:kubernetes component:networking Python Warning... Python code Ahead!

Projects

Apache CloudStack 4.22.1
Status: In Progress

Milestone

4.22.1

Development

Successfully merging this pull request may close these issues.

2 participants

@weizhouapache @blueorangutan